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SERENDIPITY AS A SOURCE OF ; 
EVOEUTIONARY PROGRESS IN SCIENCE 

1. Are Scientific Discoveries Analogous to Blind Mutations? 

Evolutionary epistemology (EE) models the evolution of science on the Neo- 
Darwinian scheme of blind-variation-and-selective-retention. ! Blind vanation 
in science means that new ideas and theories, are generated independently of 
the problems they eventually solve or of the data they eventually explain Karl 
Popper and Donald Campbell relate this requirement to the fact that it is 
logically impossible to validly infer empirical generalizations or theories from 
observational data. It is now widely accepted that there is no logic or universal 
method to arrive at true or successful hypotheses. Furthermore, irrespective of 
the manner in which a given theory is discovered, there is no logical or analytic 
method of determining, before testing the theory, whether it rs true, or what is 
the probability that it is true. If, indeed, there is no rational theory-generating 
method and no analytic way of assessing a theory's validity, there is; no a prion 
justification for the theory. This is why Campbell qualifies new scientific ideas 
or theories as "unjustified variations" (Campbell, 1974a). However, do these 
"unjustified variations" truly have the same significance as blind mutations or 
recombinations in biology? , . . . . io 

At first sight, the answer to this question would seem to be in the negative, 
considering that in conceiving new theories, we are already equipped with a 
guiding apparatus even though this apparatus itself is an evolutionary product 
in the present article, we shall indeed discuss the weakness m this somewha 
simplistic presentation of the case for evolutionary epistemology; we claim that 
in "normal" science, the scientist is guided in his conceptual inventions by a 
certain "wisdom". We then present a different version of EE, m which the 
"blind" mutations are represented by serendipity, a common feature that we 
consider as fundamental and intrinsic rather than accidental. It is essential to 
the evolution of "revolutionary" science. 
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One of the major programs of EE expounds the view that our cognitive 
apparatus is itself an evolutionary product — both on the organic and on the 
cultural levels. Our cognitive apparatus determines our ways of concept 
formation and determines what kinds of predicates will appear in our natural 
languages, and thus our standards of similarity. We apply a Kantian outlook: 
we impose our notion of similarity and our regularities upon the world. 
However, our system of natural kinds and our conceptual systems are noi 
eternal and are not immune to revisions. In science, the system of natural kinds 
is a product of the selection of ideas and theories. Electrons, which have both 
particle and wave aspects, are natural kinds in science, although natural 
languages do not accommodate this kind of predicate. Scientific language is 
thus the successor of natural language in this respect: it is a product of an 
extended cognitive apparatus which has evolved with science and which 
consists of the widely accepted world-view of the scientific. community. 

Our cognitive apparatus, our general expectations and our system of natural 
kinds are genetically- and culturally-based. However, they are not infallible 
and are not rationally justified. Since they are the results of a natural selection 
process, they reflect both the nature of our species (our interests and needs i 
and the structure of the environments in which they have evolved. Thus, we are 
imprisoned within our conceptual system. But, unlike what is claimed b> 
"pessimistic" Kantianism, we transcend this system in the process of scientific 
evolution. 

The system of natural kinds and the related general world picture thus guide 
us in the construction of a definite hypothesis (among the many logically- 
possible ones) when explaining a given set of data or when solving a given 
problem; i.e. they fulfil the task of narrowing down the range of possible 
explanations or solutions, and in many cases we are left with a unique 
possibility. Let us look first at an example from everyday life. Suppose we are 
reading a book and it becomes too dark to read; if there is a lamp in front of 
us, we do not have to guess blindly in order to generate the hypothesis which 
will almost always solve our problem. We simply hypothesize that the solution 
is to switch on the lamp. Although there is no true logical justification for thK 
hypothesis, we do not discover it blindly or generate it randomly. In arriving at 
our fallible solution, we are guided by our implicit rules of induction and by 
our system of natural kinds (the latter determines what sort of predicates are 
amenable to inductive projection). This sort of solution is fallible, but in mos, 
cases successful. Thus, although we go beyond what is strictly known (we do 
not really know what will happen when we press the button), and although our 
hypothesis is logically unjustified, we do not arrive at it blindly; our prior 
expectations and our general world picture yield algorithms or heuristics which 
guide us in explaining given data or in solving given problems. It is in this sens.; 
that the process of discovery of a solution to a problem would appear to 
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contradict the analogy with a blind mutation, which is generated indepen- 
dently of its contribution to the survival or the needs of the organism. 

Thus in the development of science, we do indeed have a very elaborate 
guiding apparatus. "Normal" science, especially, is based on a relatively stable 
world picture and conceptual system, on established general theories and on 
methods of theory-construction and concept-formation. Thus, problem-solv- 
ing in normal science is guided. The prevailing tradition or heuristic partially 
guides scientists in the choice or in the construction of a hypothesis. For 
example, in constructing an empirical law scientists are guided either by 
inductive rules or by statistical methods. Alternatively, there are heuristic 
principles for the construction of explanatory theories which are sometimes 
derived from a general metaphysical outlook or world picture Such is. tor 
example, Emile Meyerson's principle (1908) that theories of material changes, 
e g theories^ of chemistry, have to be constructed out of conserved sub- 
stances", such as atoms and fundamental particles, and conservation laws; the 
general "recipe" is that whenever some new phenomena do not obey the 
conservation laws, science has to look for new conserved substances and new 
conservation laws. In the nineteenth- and twentieth-centimes theories of the 
structure of matter were developed more or less according to this prmciple. It 
has been shown (Ne'eman. 1966, 1988) that the successful new developments m 
the physics of particles and fields, for example, also followed this recipe and 
that at the foundation of this approach there is a classification Another 
example of a ("second order") heuristic principle guiding the evolution of 
science is that successful scientific explanations in a given field serve as models 
in constructing further explanatory hypotheses in that field and m other fields 
(for example, this principle guides us in constructing our present theory) In 
physics, spontaneous symmetry breakdown was applied to particles and fields, 
after its success in understanding phase transitions in condensed matter 
(Goldstone, 1961; Nambu and Jona-Lasinio, 1961; Higgs, 1964). Another 
example is the idea of quark confinement, which was inspired by tne Me.ssner 
effect in superconductivity (Nambu, 1976). 

Thus, in normal science, even more than in everyday life, the typical case is 
that scientists appear to solve problems by intentionally trying to solve them, 
unlike the case of blind mutations, which do not arise as a response to selective 
environmental pressures. The fact that problem solving in normal science is 
not blind would therefore seem to contradict the parachgm of natural select on 
Campbell however, in his (1974b) article gives two arguments showing that 
natural selection still operates in the evolution of «e . The ^ argun^nt 
maintains, as we mentioned above, that the guidmg scientific world picture or 
tradition is itself a product of preadaptation, i.e. it is a product of selection on 
the scientific, cultural and organic levels. The range of variation on the 
scientific level is thereby only reduced by selective processes at the cultural and 
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organic levels; our cognitive apparatus, which is a product of organic and 
cultural evolution, reduces the range of possible ideas and theories. The 
scientific world picture, which is a product of selection on the scientific level 
then further reduces the range of possible variation on the level of normal 
science. We observe, therefore, the following rule in this hierarchy: the range of 
possible variation at any given level is reduced by selective processes at the 
underlying level (see Amundsen, 1989). Thus, normal science is preadapted b\ 
the process of selection to its domain of investigation. 

If we look for the parallel situation on the organic level, we notice that the 
range of possible variation is limited by the constitution of the organism's 
genotype and by the laws of molecular biology. More specifically, the range of 
mutations which a given gene can undergo is restricted by the gene's structure. 
Hence the mutational repertoire of a gene pool is restricted or determined b\ 
the evolutionary history of the species, just as the repertoire of new ideas in 
science is restricted by tradition or by the world picture. Furthermore, as was 
argued by Francisco Ayala (Dobzhansky et al, 1977, pp. 65-66), when a 
species is in a state of stability (which is the parallel of normal science), and 
when the environmental conditions are stable and the species does not move 
into a new habitat, it is more probable that new mutations will be detrimental 
rather than advantageous. The reason for this is that if a certain variation does 
not appear with a high percentage in the gene pool, it is most probable that it 
has been tried in the phylogenetic history of the species and has already been 
repressed. Only radical environmental changes might still expose an advan- 
tageous variation. The parallel statement with respect to science is that 
radically new ideas are repressed in a mature, or an established, stage of 
normal science; when unexpected experimental data are not produced, no 
radically new experimental technology is introduced and no new theoretical 
results . are imported from other areas. Thus, the presence of a restricting and 
guiding tradition does not contradict the model of natural selection. 

Campbell's second and main argument, in defending natural selection in 
science, is that even in the presence of a tradition and a background knowledge 
there still must remain an element of blindness in scientific problem-solving, 
since the tradition or heuristic and the background knowledge do not uniquely 
determine the solution for a given scientific problem. Thus, Campbell main- 
tains that, in general, there remains a range of possible solutions among which 
the scientist can only choose blindly, i.e. independently of the data or of the 
problem to be solved. His argument is analytical or logical: "In going beyond 
what is already known, one cannot but go blindly. If one can go wisely, this 
indicates already achieved wisdom of some general sort . . . which limits the 
range of trials" (ibid., p. 422). Note that to "go wisely" still means here to go 
blindly, though within a narrower range of trials. This brings us back to the 
logical argument mentioned at the outset. Here the argument applies to the 



Serendipity in Science 



situation where we are equipped with a guiding apparatus and background 
In" edgT ^deed, logical inference is content-preserving so that loyally w 
Zo iS^any piece of knowledge which exceeds the information contained 
.The poises, including the information carried by the guiding apparatus, 
namelv our genetically- and culturally-inherited wisdom. 

Howeve in contrast with the above argument, in many cases scientists do 
-r^newpieces of knowledge, including new laws andtheor.es, ma non- 
b nd manTr There are two major ways of doing this: by deductive inference 

1 torn S equationl Ho»ever, although the results of a deducts mterence or a 

always true that the results are k no Maxwell "knew" about 

lor ems of Euclidean geometry as soon as he learns the adorns. However 
tduTon and mathematical derivation are by no means ^^^d 
deduction is the prototypical way of gairnng new knowledge in 

" Deductive inference is not confined to deriving theoretical predictions from 
a Sven Alory The most common way of gaining new knowledge by deduc- 
tiT r by mathematical calculation is when scientists derive ■ 
a law or a theory in junction with ^^^^^^X 
or imtial conditions. Thus, if the data or Aeimtmlcondu^n ^ accept, y 
the scientific community as true or rehabie and rf the ^ » J"? * 
established, then the prediction may constitute a new piec « ofkn^ 
anv case the prediction can be tested experimentally and if the results agree 
any case, me jhc rnnrlude that we have here a new piece of 

Ne^'JSL- or ouanturu mechanics, respect,,*, t„ 

«rr^£^£s w U ch ts — o„ 



510 Studies in History and Philosophy of Science | 

deductive inference and which is therefore non-blind. It includes research 
programs (e.g. Lakatos, 1970) or processes of problem-solving which are 
guided by some comprehensive heuristic. We may view these processes as 
"generalized" inferences, as if the heuristic tills the gaps in the deductive 
inference, playing the role of an "inference-license" or of a missing premise. 
The accepted heuristic for problem-solving and for theory-construction in a 
given field is derived from the guiding apparatus of the scientific community. 
The heuristic narrows the range of possible explanations or solutions so that it 
may reduce scientific inference to a deductive inference. The example of the 
discovery of the planet Neptune is instructive. The anomalies in the motion of 
Uranus in view of Newtonian theory were explained by Adam and Leverrier 
by assuming the existence of an unknown planet, Neptune, perturbing Uranus' 
motion, besides the perturbations caused by Saturn. The assumption about the 
existence of a perturbing planet was guided by the general heuristic that the 
motion of a planet is only affected by gravitational forces due to the sun and 
other planets. This heuristic was not directly derived from Newtonian theory 
but was tacitly assumed. No one thought about other possibilities, such as the 
possible existence of other forces affecting planetary motion besides gravi- 
tation, or a change in the law of gravitational force; t he law of force was part 
of the theoretical "hard core". The theoretical hard core and the guiding 
heuristic did not have any logical validity but they were parts of the paradigm 
or the guiding apparatus at that time. Indeed, Leverrier himself similarly 
postulated the existence of another planet, Vulcan, in order to explain the 
abnormal behavior of Mercury. Vulcan has never been found. Instead, it was a 
change in the law of force, namely Einstein's general theory of relativity, that 
solved the problem, breaking out of the above paradigm. Thus, the problem 
regarding Uranus' motion was solved by calculating the position of Neptune 
on the basis of Newtonian theory and the available astronomical data. 
Although the mathematical solution involved some guessing, Adam and 
Leverrier arrived independently at the same result. This is, therefore, a typical 
case of a non-blind discovery; the solution of the problem of Uranus' abnor- 
mal behavior was obtained as a result of an activity which aimed at solving 
that problem. A similar situation developed in particle physics when the J/Psi 
particle was discovered in 1974. It was immediately explained by the postula- 
tion of a fourth type of quark, the "charmed" one. This would also explain the 
non-existence of strangeness-changing weak currents (the "GIM mechanism"). 
The hypothesis was confirmed by the discovery of the D mesons, analogous to 
K mesons, but with the strange quark replaced by a charmed one. 

The second way of generating new variations in science in a guided manner 
is by inductive generalizations or by statistical inference from observed data. In 
this manner empirical generalizations and laws of nature are derived from 
observation and experiment without a resort to blind groping. The available 
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solving. Our main point, however, is that, in principle, blindness is not a 
necessary condition for gaining new knowledge and for generating new solu- 
tions to problems or new explanatory theories. On the contrary, in normal 
science scientists expect to solve problems and to discover explanatory theories 
by inference or by heuristic-guide problem-solving. Thus the model of blind 
variation would appear to fail when we refer to normal science, which does no! 
break with tradition; if scientists adhered to this model they would not waste 
so much time and energy in trying to solve problems in a methodical or a 
guided manner. It is only radical or "revolutionary" changes in science that 
can clearly be described as typically, and in certain cases (as we will see in the 
next section) necessarily, involving blind variation. However, even scientific 
revolutions have their roots in normal research, i.e. in a guided activity. 

And yet, as we will show in the next section by studying the nature of the 
research process, the paradigm of natural selection can indeed be retained over 
a very wide range. We will suggest that science advances via a special class of 
blind discoveries, even though these originate in the intentional or guided 
action of problem-solving. Although scientists do employ methods and heuris- 
tics which guide their research in view of the data, these methods and heuristics 
frequently lead them to unexpected discoveries. Furthermore, we will see that 
the "mechanism" which turns a problem-guided activity in an unforeseen 
direction may also be responsible for the "revolutionary" discoveries which 
destroy the prevailing order and open new vistas for science. 



II. Serendipity-driven Advance of Science 

In The Sleepwalkers (1964), Arthur Koestler writes: ". . . the manner in 
which some of the most important individual discoveries were arrived a. 
reminds one more of a sleepwalker's performance than an electronic brain's.'" 
Our thesis provides a specific interpretation for these words. We would like to 
suggest that radical scientific changes are very often triggered unintentionally 
by an innocent problem-solving activity within normal science. At times an 
activity intended to solve a given problem leads to unintended results. This 
pattern of discovery might still keep us within normal science. However, il 
might initiate a process of scientific revolution. In fact, blind discovery is a 
necessary condition for scientific revolution; since the scientist is in general 
"imprisoned" within the prevailing paradigm or world picture, he would nol 
intentionally try to go beyond the boundaries of what is considered true or 
plausible. And even if he is aware of the limitations of the scientific world 
picture and desires to transcend it, he does not have a clue how to do it; he is 
blind to any territory which lies outside the one governed by his world picture. 
Here Campbell's argument applies: in going beyond the prevailing world 
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picture, one cannot but go blindly. In the previous section we mentioned two 
ways of gaining new knowledge in a non-blind manner and both ways will 
always keep us within the confines of our framework of knowledge. By 
, [eduction we cannot construct a radically new conceptual system or world 
view. Also, the heuristic which helps us in constructing theories in view of the 
observational data is part and parcel of our world picture and thus it cannot 
guide us in transcending the world picture. 

Thus, one of the major ways of transcending an established state ol 
knowledge is to do it unintentionally while trying to solve some problem 
within the confines of the prevailing paradigm. Indeed, it is well known to 
working scientists that a large percentage of research programs m natural 
science deviate from the original path planned for them, as if chance "drags" 
the research program in a new direction, a direction which sometimes leads to 
the discovery of a new phenomenon or a new domain of reality. This is how 
serendipity is realized in natural science (see Ne'eman, 1980). 

The term "serendipity" was coined by Horace Walpole. In a letter written to 
Horace Mann in January 1754 he says that he formed this term following his 
reading of a "silly fairy tale" called "The Three Princes of Serendip" (Serendip 
is an ancient name for Ceylon or Sri Lanka). The three heroes of this tale 
"were always making discoveries by accidents and sagacity, of things they were 
not in quest of (Lewis, 1960). The Oxford English Dictionary defines the term 
as "the faculty of making happy and unexpected discoveries by accident". The 
Dictionary adds, however, the following sharper definition: "looking for one 
thing and finding another". The latter definition refers to cases where one 
looks for A and finds B. Thus the scientist may act in a guided manner m order 
to solve a problem — while he discovers that the end result provides a solution 
for another problem, of which he was not aware. The notion of serendipity 
implies that the discoverer is aware of the fact that he found B, or at least of 
the fact that he found something unexpected or significant. Thus, science can 
benefit from a hint given by Nature only if there are open-minded scientists 
who grasp the significance of the hint. Sometimes the scientist who made the 
discovery is not aware of the full significance of his discovery while other 
scientists complete the task. So in many cases serendipity m science is a 
collective enterprise. 

One of the best known cases of that nature is Fleming's discovery ot 
penicillin Taking a Petri dish containing a bacterial culture he noticed that the 
loose cover had not been properly set, and a mold had grown over the exposed 
area The bacteria, on the other hand, were dead. This may have occurred to 
other researchers before him and their conclusion must have been to see that 
lids should be properly clamped . . . Fleming realized that this implied that 
some molds could kill the bacteria. 

A very similar sequence ushered the presently popular "superstnng' hypo- 
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thesis (see for example Schwarz, 1985) in physics. "Dual Models", later shown 
to represent the quantum excitations of a string, were developed in order to 
explain the strong nuclear force. One difficulty that appeared to plague the 
model was the appearance of a spin-two massless state as the lowest physical 
state of the string's spectrum of excitations. Strong interactions involve onh 
massive states, and physicists tried unsuccessfully to give a mass to this spin- 
two state. Yoneya (1974) and Scherck and Schwarz (1974) suggested that the 
quantum string be reinterpreted as a theory of quantum gravity (since graviU 
is mediated by gravitons, massless spin-two "particles") rather than of the 
strong nuclear interaction. The string tension, the only free parameter in the 
theory, thus had to be changed by twenty orders of magnitude! Thus a 
theoretical construct invented to explain the strong nuclear force led to a 
deeper understanding of quantum gravity. 

Our main claim is that serendipity in science is not a casual phenomenon. 
Understanding the role of serendipitous discoveries will contribute to under- 
standing the epistemic role of science and its evolutionary character. Serendi- 
pity supplies science with its blind edge. The human mind makes plans which 
have a chance of yielding successful results only in familiar territories of 
Nature, while serendipity causes science to deviate from its planned course 
towards unexplored domains of Nature. Actually, serendipity enables the 
human mind to transcend established frameworks of knowledge, established 
world pictures. 

The requirement of blind discovery is realized in the phenomenon of 
serendipity in such a way that it does not contradict the fact that scientists do 
act intentionally and that they direct their efforts towards solving given 
problems. Indeed, when a scientist makes a serendipitous discovery he does not 
guess blindly. Rather he is occupied with directed problem-solving in the 
framework of a research program, employing algorithms and established 
methods. However, since he tries to solve problem A, being aware of problem 
A, while accidentally solving (another) problem B, the solution of problem "•; 
is, indeed, generated blindly with respect to B. Thus, the discoverer does act 
intentionally, being affected by the problem he intended to solve; and yet Ik- 
ends up making a "blind" discovery. By this we reconcile in a straightforward 
manner the fact that science appears to be a guided enterprise with the 
evolutionary model of blind variation. Thus, variations are generated via the 
activity of problem-solving and are selected by problems which they were not 
intended to solve. We might describe the situation by saying that in his 
problem-solving activity the scientist- generates "solutions in search of prob- 
lems". 

Now, the more profound question is why does science advance in this 
manner? Why, for example, shouldn't scientists who wish to find novel 
solutions to problems (or to free themselves from the prevailing world picture 
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and at the scientific levels are not generated in vacuo, out of nothing; they are 
imposed on existing forms — existing genes or existing ideas — respectively. 
Thus, serendipitous discovery guarantees both independence in terms of 
problem-solving pressures (blindness), and continuity. 

It should be stressed that serendipity is needed for the advance of science 
because we conduct our scientific investigations from within a given frame- 
work: a given conceptual system or a given world picture. Had we adopted the 
naive empiricist view that we can acquire objective knowledge about the world 
just by making unbiased observations, then serendipity would be unnecessary . 
Serendipity is needed in order to transcend an established framework of 
knowledge. 



III. Implications for the Philosophy of Science 

It is evident from the above discussion that the principle of discovery by 
serendipity is both descriptive and normative. It is descriptive since we claim 
that science in fact advances by serendipitous steps. To be more precise, our 
approach is explanatory rather than merely descriptive; we start with an 
evolutionary theory of science which, on the one hand, is checked against 
historical evidence and which, on the other hand, attempts to explain scientists' 
decisions and acts. Our approach is normative, since it maintains that in view 
of the basic assumptions of our theory, science can make significant progress 
only by serendipity. Hence we may treat our theory as part of an explanatory 
philosophy of science which has both explanatory and prescriptive implica- 
tions (see Kantorovich, 1988). Our theory explains, for example, the fact that 
scientists prefer theories which yield unexpected predictions. It also may add to 
our understanding of two phenomena which characterize modern science - 
mathematization and cooperation. 

(a) Predictability and epistemic profit 

The principle of discovery by serendipity sheds light on one of the most 
important methodological requirements of a scientific theory, i.e. that a theory, 
besides explaining known phenomena, should generate successful predictions 
of unexpected events or phenomena. Thus, for example, Maxwell's electromag- 
netic theory unexpectedly explained the phenomenon of light, and in addition 
predicted the existence of radio waves, establishing relations between optical 
and electromagnetic phenomena. This requirement cannot be accounted for by 
logic alone. We could perhaps be satisfied by "relegating" it to the psychologi- 
cal arena; yielding an unexpected prediction has a dramatic effect, like telling 
the future or performing magic, thus persuading scientists to accept the theory. 
However, in view of our principle of serendipity we can avoid this sort of 
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rtt j, or r *. <^^^^z^ ^ 

In view of onr principle, we can also explam the nega 
a*"*" 

some empirical da a if they do »« J" * bewee „ the theory and 

for example, whieh explained away ever^ '^'^ fit Sllch ad h „ 

the facts by "M^l^jS.W 

modifications are totally guided by »e w 

that the generation of new variations be blind ^ some of the data y P 

Classifications, such as Linneus' ^^^^^^particles. 
leev's chart of chemical elements or the SU(3 : symmetry ot P 
are interesting when they predict new speoes " « - to \ 
However, they then also take on a Even 
B", with B's emergence representing a broadening ot the Known 
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if we know from experience that new species may exist, we do not know what 
they are without the classifying theory. 

A straightforward case of serendipity occurs when the theory yields an 
unexpected explanation for a known phenomenon or an unexpected solutic 
for a known problem. For example, as we mentioned above Maxwell's theo; 
explained light, Newton's theory of gravitation explained the phenomenon of 
tides and Einstein's general theory of relativity solved the problem of the 
abnormal behavior of Mercury. Thus, one of the major cases of advance 
occurs when a new scientific theory solves a known problem which it was not 
intended to solve. The discoverer in this situation solves the problem by using a 
theory which was constructed or discovered by scientists who were not aware 
of the problem. 

Thus, serendipitous events can be divided into two main classes: 

(1) intending to solve (explain) A, but solving (explaining) B instead; 

(2) intending to solve (explain) A, and solving (explaining) B in addition to / . 

The case of an unexpected prediction belongs to class (2). Class (2) als 
includes cases where a research program which solved the original problem A 
continues to evolve and solves problems, explains phenomena or leads to ideas 
which were not dreamt of at the start. Ernest Rutherford, for example, was not 
satisfied with the idea of light quanta, since he thought it lacked a physical 
basis, yet the Bohr- Rutherford model, which developed from his initial model 
of the atom, was based on this very idea and lent it a high degree of 
confirmation. In general, a research program starts with an initial version of a 
theory and ends up with a different version due to ad hoc corrections and 
modifications made in the course of the development of the research program. 
Thus the later version can be seen as an outcome of the initial version, the 
initial discovery. The initial version is intended to solve a given problem, 
whereas the subsequent versions of a progressive research program (Lakatos, 
1970) solve additional problems. Thus, when we demand high predictive power 
we refer not only to a given theory as it stands, but to its potentialities which 
can become actualized in a dynamic process of modifications and improve- 
ments (see Kantorovich, 1979). 

Genes or gene combinations, too, undergo "ad hoc" changes. If we look at 
the manner in which organs actually evolve, we can see that an evolutionary 
line does not seem to be a preplanned process. Rather that reflecting a 
program or a purpose, the structure of an organism reflects the past, namely, 
the history of the evolutionary line. If the evolutionary line starts with a certain 
structure, imperfectly adapted to a certain niche, all future adaptations to 
changing environmental conditions will be "ad hoc" modifications imposed on 
the initial structure. Thus organs undergo changes which make them capable 
of performing new functions. For example, jaws were developed in fish from 
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to the potentialities inherent in the original structure. 

serendtpitous developments-, the com plex -a-h 
of scientific theories and the ■highly ™'™ £ .ISen, levels - 
« these ^f^^^^t^^ As 

tas a hfe of its own and does no, "^^ ^ d^ 

which leads to a solution of a problem K ™ 

nature of modern scientific research. 



IV. Landmarks of Serendipity In Physics 
' In this section we will describe two of the greatest revolutions in physics in 
the light of the principle of serendipity. 

(a) Kepler: the --^t^teroes of Koestler's Sleepwalkers. Kelper's 
distances between gov-ed 5 Ihematical relations and 
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then looked for the solution in plane geometry. After he failed there too, he 
turned to solid geometry. The erroneous number of planets, six, gave him the 
clue for his model of five Platonic solids (the five regular convex polyhedra) on 
which he erected the universe. He associated the five perfect solids with the the 
interplanetary regions and tried to find out how the proportions between the 
five solids are related to the distances between the orbits. After many unsuc- 
cessful attempts to explain away the discrepancies between his model and the 
observational data, he turned to another Pythagorean model: he tried to 
construct the heavenly motions as "a continuous song for several voice- 
(perceived by the intellect, not by the ear)". His model of the universe wa-. thus 
constructed out of the five Platonic solids and the musical harmonies of the 
Pythagorean scale. In his attempts to improve his model he needed exact 
figures of the eccentricities and mean distances. These were supplied by Tycho 
Brahe. However, Kepler encountered new problems in Tycho's data and found 
other parameters to investigate, instead of the relative distances of the planets. 
The attempts to solve the new problems eventually led him to the discovery of 
his three Laws. 

The processes by which he arrived at his Laws involved many sequences of 
trials and errors. His Pythagorean models stayed in the background and set the 
framework for his investigations. However, when he struggled with the data, 
he arrived at his successful solutions mostly by error or by chance, not always 
recognizing their value or significance. His struggle with the Martian orbit led 
to the First Law. His first assumption was naturally that Mars' orbit is 
circular. Then he hypothesized an egg-shaped orbit. After abandoning the egg- 
hypothesis, he constructed the Martian orbit by very precise calculations and 
obtained a circle flattened at two opposite sides. He then found by chance that 
a simple relation holds between two quantities related to the geometrical form 
of the orbit. As a result, he obtained a simple formula expressing the functional 
relation between the planet's distance from the sun and its position (Koestler, 
pp. 336-338). Since analytical geometry was not available in his time, he did 
not realize that the formula characterizes an ellipse. And yet in his next step, he 
conjectured that the orbit is an ellipse. He thus discovered his First Law twice: 
once by chance and once by making a hypothesis and testing it. This hypothe- 
sis was almost the only one left for him after he had eliminated all other 
alternatives. The belief in circular orbits was so deeply entrenched that Kepler 
could depart from it only by chance or by a lengthy process of trial and error. 

The process by which Kepler arrived at the Second Law was hazardous in a 
different way. He discovered that the radius vector of the earth's orbit sweeps 
out equal areas in equal times, after making three erroneous assumptions 
which somehow led to the correct result. The assumptions were the following: 
"(a) that the planet's velocity varies in reverse ratio with its distance from the 
sun; (b) the circular orbit; (c) that the sum of eccentric radii vectors equals the 
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area " (ibid., p. 591). With respect to assumption (b), note that he discovered 
the Second Law first. This process of "error begetting truth" (to use Koestler s 
expression), which is characteristic of Kepler's investigations, amounts again 
o blind d scovery. Indeed, if we start a deductive inference rom false 
assumptions there are equal chances to get a true and a false conclusion and 
the inference is thus reduced to gambling. 

The discovery of the Third Law came about after many years of search for a 
correlation between a planet's period and its distance Kepler arrived at the 
Law after innumerable trials. Hence chance did not play a significant role m 

the final discovery. w;»hm,t 
In general, Kepler did not realize the importance of his Laws. Without 
Newton's theory the Laws looked arbitrary. The belief m circular orbits of 
heavenly bodies was deeply rooted in the Ptolemaic and the Copern.can world 
picture and Kepler could see no reason why the planets should move in ellipses. 
He therefore treated the First Law as a necessary evil. The Second Law was 
treated by him as a computational device. The Third Law was treated just as 
one more step in the construction of Celestial Harmonies. Kepler thus though 
that he was constructing his Pythagorean models, the three Laws bemg just 
building blocks in this process. He was partially m^ risoned withm the o d 
traditions of Neoplatonism and Pythagoreamsm. He could not therefore 
realize that he had made a decisive step in transcending this paradigm . 

tll ^r started with a problem in the old "paradigm';, trying to give 
mlema'tical sense to the number of planets and to their spatial distribute 
SfeXd up identifying the mathematical regularities of planetary motton 
discovery which led eventually to Newtonian Mechamcs and to a new para 
tm The femework of Kepler's grand research program was set while Kepler 
ta^Ilty bl"d to the final data and to the final problem which Ik = eventually 
loTv d Although Kepler's original model of the solar system has left no 
emnantTphysics, the mathematical element of his Pythagorean outlook did 
ZoTvJt of the world picture of physics, established by the: Newtonian 

V ZTZ trace Kepler's train of reasoning from his writings. Other great 
We can trace and Newton, mainly give us the final 
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same affection for the reader, I follow the same methods.'- (Cited in Koestler, 
The Sleepwalkers, p. 318.) Indeed, if the notion of "serendipity" were available 
to Kepler he would have used it, since Columbus' story is one of the most 
prominent examples of serendipity in human history. It seems, therefore that 
Kepler felt that the zigzag path of his investigations is significant enough to 
deserve a description in his scientific writings. 

(b) Planck: the reluctant revolutionist 

Of the two revolutions which shook human thought at the beginning of the 
twentieth century the quantum revolution seems to be the more radical. 
Relativity theory was based on classical theories, whereas the idea of energy 
quantization and the. subsequent principles of quantum mechanics sharply 
depart from classical physics. (Indeed, nowadays relativity theory is included 
in textbooks as part of classical physics.) It is suggestive, therefore, that the 
quantum revolution arose as a result of a serendipitous discovery, whereas the 
special theory of relativity emerged out of a systematic analysis of known 
concepts and theories. And yet even in this case, a new theory of space and 
time (B) arose out of measurements that were meant to measure the velocity of 
the earth through the ether (A). 

Planck attempted to solve a problem concerning the Second Law of Ther- 
modynamics and ended up solving the problem of black-body radiation. The 
implications of the discovery had a radical impact on the whole world picture 
of science. Planck treated the Second Law as an absolutely valid principle 
Hence he did not accept Boltzmann's statistical approach, which treated the 
increase in entropy, asserted by the Second Law, as "highly probable" rather 
than absolutely valid. Planck spent many years trying to clarify and under- 
stand deeply the Second Law. Before the turn of the nineteenth century he 
consequently became interested in the problem of black-body radiation. 

The problem of electromagnetic radiation emitted from a very small cavity 
m a hot furnace had occupied physicists for half a century. The discrepancy 
between the observed distribution of intensity of the emitted light for different 
wavelengths and the predictions of classical physics was termed "the ultra- 
violet catastrophe". The curve based on the experimental data showed a very 
weak intensity for short wavelengths, in the ultra-violet region. The intensity 
increased with wavelength until it reached a maximum at a certain wavelength 
(which corresponded to the dominant color of the light emitted from the 
furnace) and then decreased and again became very weak in the infra-red 
region. 

The theory of black-body radiation was developed by Rayleigh Jeans 
Kirchhoff and Wien on the basis of classical theories: the electromagnetic 
theory for treating light radiation and Newtonian mechanics for treating the 
oscillating electrons within the walls of the furnace, which absorb or emit the 
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light. Since the electrons in the walls must be at equilibrium, they have to emit 
and absorb on the whole the same amount of radiation energy. Hence, a third 
theory — Boltzmann's statistical mechanics — was incorporated in order to 
calculate the energy distribution in a state of equilibrium. Only in the infra-red 
region was the curve of the energy distribution (or the intensity of the emitted 
light at equilibrium) predicted by these theories indeed similar to the experi- 
mental curve. In the ultra-violet region, the intensity increased indefinitely with 
decreasing wavelengths. Thus, at least one of the three theories employed for 
the calculation must have been wrong. 

As mentioned above, Planck's motivation in attacking this problem 
stemmed from his interest in the Second Law. He had studied problems related 
to the scattering of electromagnetic waves by an oscillating dipole, which had 
direct implications for the scattering of light by the furnace's electrons. His aim 
was to understand how the radiation within the furnace is kept in a state of 
equilibrium at constant temperature. He was thus engaged in the thermodyna- 
mics of radiation. In the course of his investigations he planned to derive the 
Second Law for a system consisting of radiation and charged oscillators, in an 
enclosure with reflecting walls. We will not describe here the details of these 
investigations with all their technicalities. We would rather refer the interested 
reader to Martin Klein's detailed historical article on this subject (Klein, 1966). 
We will only cite a few statements describing the aim of Planck's research 
program. Klein writes: "The ultimate goal of this program would be the 
explanation of irreversibility for conservative systems and, as a valuable by- 
product, the determination of the spectral distribution of black-body radia- 
tion." In doing this, Planck hoped to "put an end, once and for all, to claims 
that the Second Law was merely a matter of probability. How was Planck to 
know that he was headed in a very different direction, that he had started on 
what he would later call 'the long and multiply twisted path' to the quantum 
theory?" It is interesting to note that, in describing Kepler's thought, Koestler 
speaks about the "zigzag course of his reasoning". This seems a paraphrase on 
the above-cited words of Planck, taken from his Nobel address. Needless to 
say, Planck did not succeed in attaining his original goal (just as Kepler did 
hot) and the by-product turned out to be the major result of his enterprise. 

In the last stage of his long serendipitous path he found that the problem of 
black-body radiation would be solved if the energy of an oscillator could take 
only values 0, E , 2£ , 3E . . ., where E = hf, f being the frequency of the 
oscillations and h a constant to be determined by experiment. Boltzmann had 
already used this idea as a computational device, going to the limit E -*0. 
After six years of unsuccessful attempts to solve the problem, Planck decided 
to employ E without going to the limit. Planck explains this move as "an act 
of desperation" and he treats it, as he says, as "a purely formal assumption, 
and I did not give it much thought except for this: that I had to obtain a 
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positive result, under any circumstances and at whatever cost." Thus, Planck's 
discovery was doubly serendipitous. First, his original goal was related to the 
Second Law of Thermodynamics but he ended up solving the "ultra-violet 
catastrophe". Second, when he arrived at the solution of the latter problem, he 
employed it reluctantly, without realizing at first its far-reaching implications. 
He treated the energy quantization as a computational device rather than as a 
law of Nature. He did not commit himself to the existence of quanta as real 
physical entities. 2 This may remind us of the instrumentalist spirit of 
Osiander's preface to Copernicus' De Revolutionists, in which Osiander 
explains that Copernicus meant his heliocentric hypothesis to be just a 
computational device, or Kepler's treatment of his second Law. When Planck 
used his computational subterfuge, he did not dream that it would have 
immediate implications in explaining phenomena such as the photoelectric 
effect and atomic spectra, not to mention the subsequent developments and 
successes of quantum physics. Einstein was first to treat quanta seriously, in 
explaining the photoelectric effect in 1905. 

V. Serendipitous Discovery of Natural Phenomena 

There is a different kind of serendipitous discovery which also contributes as 
an evolutionary process to the advancement of science, but does not seem to be 
analogous to blind variation. We are referring to the discovery of an unex- 
pected phenomenon such as that of X-rays and radioactivity. As we shall see in 
the following examples, the original aim, of the investigation and the final 
result in these cases were entirely different — researching A and discovering B. 
The final result, however, was not a solution of a problem but the emergence of 
a new problem awaiting a solution. The discovery of an unexpected phenome- 
non in the course of normal-science research is similar to a new environmental 
pressure exposed by the species' activity (such as a migration or an activity 
which undermines the ecological balance in the natural habitat). The new 
environmental conditions pose a challenge to the species, which has to 
overcome new dangers and difficulties or exploit new opportunities. There are 
three possible sources of variation which might enable the species to meet the 
challenge: 

(a) Preexisting genes which are responsible for other functions. For example, 
in certain insects genes which are responsible for metabolic functions also 
confer resistance to insecticides (in this example, the new environmental 
condition came about as an indirect result of the species' activity). 

2 One of the present authors (Y.N.) tended to regard his "fundamental field with baryonic 
charge 1/3 (Neeman, 1963, 1987) as a computational device in the beginning. They are now 

known as "quarks" and regarded as the basic bricks of nuclear matter (see Pickering 1984 p 116 
note 90). ' r ' 
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(b) Genes which undergo "ad hoc" modifications (see section 3a). 

c Genes which have been kept in a dormant state, or genes with low 
frequency in the population, are activated by the new environmenta 1 condi- 
tions and spread through the population, since they endow high survival value. 
■ llis is typical of the evolution of resistant strains of bacteria. 

Similarly, novel phenomena may be explained by an existing idea .or theory 
which was generated in order to explain other phenomena, by a modified 
Jersion of such a theory, or by an idea or theory that was latent m the existing 
paradigm. Let us describe three examples of this kind of discovery. 

H r^^M^ - to end of the ~ 

heralded the approaching upheaval. The photoelectric enect X_«y and 
radioactivity were discovered by serendipity and were later explained by 
theories whlh stemmed from the quantum idea, itself the product of serendi- 

P, The photoelectric effect was discovered in 1887 by Heinrich Hertz while he 
was conducting experiments related to the radio waves which 
covered in 1886. He used a spark generator to produce the waves In , to > cou«e 
of these experiments he discovered by chance that the behavior of the spark 
tl was affected by the illumination of the electrodes. Other experiments 
foLri Hertz's observation showed that a piece of zinc illuminated by ultra- 
S rSit became electrically charged. It was found that the effect is obtained 
Z other metals and other wavelengths of light, provided 
below some threshold, irrespectively of the mtensity of the light The metal 
became charged because negatively charged electrons were ejected from it by 
theTc dent electromagnetic energy. It was further found that the speed of to 
dected electrons was greater, the higher to frequency of the incident light, 
leasing the intensity^ the light beam only 

leaving the metal, which increased proportionally to the mtensi y. Below the 
threshold, however, no electron would be ejected at any light intensity. 

After Planck's discovery of energy quantization Einstein was very quick to 
explain the photoelectric effect by conjecturing that light waves of frequency / 
consist of light-particles, photons, each of which carries an amount of energy 
™- Theintensity of the beam is proportional to to number of photons^ 
Indeed, if the frequency of a light beam is less than some threshoM / no 
electron will be ejected, no matter how many photons tore are m to beam, 
since none of torn has enough energy to knock out an electron 

Roentgen's discovery in 1895 came as a by-product of a long research 
priram triggered by Faraday. Faraday and his followers had investigated the 
phenomena which occur when an electric discharge is set up m partly eva- 
L tubes containing two electrodes. Advances in vacuum pump 
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technology led to the accumulation of new experimental data and to the 
conjecture that the luminescence which appears near the anode is produced by 
what were 'called "cathode rays". The research program culminated in 1897 
with the results of J. J. Thomson's experiments showing that the cathode rays 
were negatively charged particles — electrons. The aim of the research 
program was to understand the nature of the cathode rays. However, before 
this aim was attained, X-rays were discovered by chance, as a by-product. 

Roentgen inserted into the cathode-ray tube a metal plate which formed an 
angle with the path of the cathode-rays. At each discharge within the tube, 
Roentgen observed a bright illumination of a screen covered with a fluorescent 
salt situated outside the tube. It was evident that the cathode rays could not 
cause this glow since it had been previously proved that they cannot penetrate 
the glass walls. It turned out that the higher the vacuum in the tube, the more 
penetrating the new rays were. 

The explanation of the X-ray phenomenon came later, with quantum theory 
and the atomic model. These rays are produced when high speed electrons 
(such as cathode, rays) bombard a target atom and as a result one of the 
electrons in an inner shell of the atom is removed. The rearrangement of the 
electrons in the shells is accompanied by a decrease in energy and an emission 
of an X-ray photon. 

The discovery of radioactivity in 1896 was even more accidental than the 
above two discoveries. Henri Bequerel knew about Roentgen's discovery and 
his aim was to find, as he says, "whether the property of emitting rays was not 
intimately bound up with phosphorescence". As phosphorescent substances he 
used uranium salts. He used a photographic plate wrapped with two sheets of 
thick black paper to protect the plate from sunlight. He placed a plate of the 
phosphorescent substance oxr the paper and exposed the whole thing to the 
sun. After developing the photographic plate, he saw the silhouette of the 
phosphorescent plate in black on the negative. One day, Bequerel tells us, 
when "the sun only showed itself intermittently, I kept my arrangements all 
prepared and put back the holders in the dark in the drawer of the case, and 
left in place the crusts of uranium salt. Since the sun did not show itself again 
for several days, I developed the photographic plates . . . expecting to find the 
images very feeble. The silhouettes appeared on the contrary with great 
intensity." After conducting further experiments he came to the conclusion 
that the phenomenon was not caused by radiation emitted by phosphores- 
cence, and that the uranium salt itself emits radiation. 

It was only after the famous experiments of the Curies that it was under- 
stood that radioactive elements such as uranium and radium disintegrate and 
change their chemical identity. Bequerel's discovery led, therefore, to the 
conclusion that chemical elements are not immutable and opened the way to 
the nuclear domain. 
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Let us now try to compare the theoretical explanations in these three cases 
to the above-listed three possible sources of variation enabling a spec.es to 
meet new environmental conditions. . t _ nr (c \ 

The understanding of the photoelectric effect ,s analogous to case (a) o r (c) 
since it employed the idea of the quantum, which was mvented for a different 
pu^o eTnd Jas not treated seriously until 1905. The understand of X ray 
s analogous to cases (a) and (b), since the phenomenon was explamed by 
aU^c IZ ^ which had evolved from, Planck's and Einstem's tdeas and 
"ich wasintended to explain other phenomena. ^^^^ 
by employing ideas borrowed from chermstry, by using a heuristic of the 
Meversonian kind for constructing matter-theories [case (a)]. 

ThT a discovery of a novel phenomenon may foster theoretical advance, 
iusfas changmg environmental conditions may foster evolutionary progress. 
Cearof Ae aLve examples the resulting theoretical advance was serendip - 
iou sin e the new phenomenon was exposed followmg an experimental 
actHty guided by an established theory or by an entrenched conception 
whereas the end result was the adoption of another theory or conception winch 
I^edthe original one. In other words, the original research employed a 
or conception to solve a given problem, whereas the end resul 
wa 1^ reaction or a radical change imposed on it. Hence the eptstemologtcal 
Zmc^of such a discovery is in tnggering the process o replacmg an 
nTrfncted conception or theory. This sort of <£^J£ 
blind discovery of new explanatory ideas and solutions of problems, erves 
tofo as a means of transcending an entrenched framework of knowledge 
7.dS£ as the example of the discovery of *«f"^ ^ 
process can be viewed as a serendipitous discovery of a solution of a techno 
E problem. The discovery of penicillin solved an acute medical problem 
SLcovery of X-rays and radioactivity solved experimental problems w m 
physt' tlelTby proving new methods for probing the structure.! matte, 
S ot y of an anomalous phenomenon which is unexpected m view of 
the entrenched background knowledge must, indeed, be serendiprtous. 

We would expect that discovery by serendipity of new phenomena will be 
mo^Went in sciences which do not yet have a fully developed theoretical 

medical sciences, such as drug research; our above example of the d c r 
nenkrllin by Fleming is repeated again and agam m tins field. It has also 
Ckal ocLrreT as we saw above, in fluid stages in the evolution of phystcs: 
oI^S«les are: Galvani's discovery leading to the electric battery, 
Brown ! sZ^ of molecular motion (two cases of interdisciplinary serench- 
^To^Zs discovery of the nature of the connection between electr, 
dty and magnetism. Other examples are described m Cannon (1968) and m 
Shapiro (1986). 
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